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The model of the three curriculuirs is central to this report. At the 
level of the education system there is the intended curriculum, 
containing the 'official 1 view of what is prescribed to be taught in 
mathematics in each country. At the second level, the level of the 
classroom, there is the implemented curriculum, the body of math- 
ematical knowledge which is actually taught, or presumed taught, to 
students by teachers. Finally, the information and skills mastered by 
the students, as demonstrated in tests and questionnaires, makes up the 
attained or achieved mathematics curriculum. 

The level of correspondence between the intended and the implemented 
curriculuirs might be termed the conformity of the educational system. 
In most countries, and for most mathenatics topics, intention runs 
ahead of implementation. Such 1 non-conformity 1 may occur for several 
reasons. The official curriculum developers may be over-optimistic 
about what teachers are reasonably able to cover in their courses, or 
the presence of differentiated or individualised instruction may inply 
different levels of coverage for students of differing abilities. 
Finally, teachers' perceptions of exactly what mathematics has already 
been taught to their students may be inaccurate. This phenomenon is 
particularly likely in countries where the tested population falls at 
the first jear of post-primary school. 

By ana large, students agreed with their mathematics teachers on the 
extent of syllabus coverage. The correspondence vas reasonably close 
in arithmetic, algebra and measurement, in most countries, but rather 
less so in geometry and statistics. In general, the student index of 
implemented content coverage was greater than the teacher index, and 
the reason for this was almost invariably a large proportion of 
students claiming that they had had the opportunity to learn the 
necessary mathematics 1 in previous years 1 . Sometimes this exposure may 
have been in mathematics classes at an earlier stage, in priirary rather 
than secondary school, sometimes in the course of other school 
subjects, special coaching lessons or mathematics oonpetitions , and 
sometimes just in the process of informal learning outside the 
classroom environment altogether . Particular topics showing large 
discrepancies across several countries were square roots, indices, 
sequences, congruence, similarity and applications of Pythagoras' 
Theorem. 

In a similar way, the degree of articulation between the implemented 
curriculum and the attained curriculum could be seen as a measure of 
the efficiency of an educational system. A system could not be 
described as 'efficient' if mathematical topics which students are 
given an 'cpportunity-to-learn' , because they are in the intended and 
the implemented curriculums and regarded as inportant, are not topics 
on which they can show high levels of achievement when tested. 
Conversely, students cannot be expected to perform well on material 
which they have not been taught. An index of 'efficiency', such as that 
developed in this report, is a necessary acoonpaniment to achievement 
scores when conparisons ars being made between countries with different 
curricular enphases in rat hematics. 
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Introduction 

Underpinning the curriculum analysis of the Second Study of Mathematics 
conducted by the International Association for the Evaluation of 
Educational Achievement (IEA) is a sinple, but powerful model, 
embodying the concept of the three curriculums . At the level of the 
educational system, there is the intended curriculum, the collective of 
intended outcomes, supplemented by course outlines, official 
syllabuses, examination prescriptions and textbooks viiich prescribes 
what it is intended should be taught in mathematics, in each country. 

The second level deals with the classroom, \rt>ere the content becomes 
translated into reality by the individual teacher, or implemented. 
Thus the iiiplemented curriculum will reflect the personal preferences 
and biases of teachers, the coverage of text-books used, as well as the 
size and composition of the classes in which mathematics is taught. It 
is clear that the implemented curriculum need not bear a strong 
resemblance to the intended curriculum, and that it is the implemented 
curriculum which finally determines the student's opportunity to learn 
mathematics. 

Finally, the attained curriculum is that assimilated by the student; 
the body of mathematical knowledge acquired and attitudes engendered in 
the process of studying the subject. Attempts can be made to measure 
this attained curriculum by tests and various types of questionnaire. 
The extent to which there is a strong correspondence betv^en the three 
curriculums is an important concern of the IEA study, and some aspects 
of this correspondence , or lack of correspondence , relat ing in 
particular to the implemented curriculum, form the basis for the 
present investigation. 

Target Populations 

Two populations of students formed the focus of the Second IEA 
Mathematics Study, approximately paralleling those considered in the 
first study, carried out with more limited goals and terms of reference 
in 12 countries in 1964 (Husen, 1967). The target Population A in the 
second study consisted of all students in the grade in Wiich the nodal 
number of students had attained the age of 13.0 - 13.11 years by the 
middle of the school year. For those countries participating in this 
study, the national Population A's spanned four grade levels around the 
pr iinar y-pos tpr imary divide, ranging from one year before the divide 
(e.g. in Hungary) to three years after it (e.g. in France). 
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Population B was defined internationally to consist of all students who 
ware in the normally accepted terminal grade of the secondary education 
system in a participating country , and who were studying mathematics as 
a substantial part (approximately five hours per week) of their 
academic program. The analysis to be presented in this report is 
limited to the first of these populations, Population A. 

Space considerations prevent a detailed consideration of the survey 
procedures and saitpling methodology of the study. These have been 
fully documented, and will be reported in the three official volumes 
from the study. It may be sufficient to note here that large, 
representative sanples of students and their teachers were drawn from 
each participating country, under the direction of their own IEA 
National Centers, following acceptance of a saitpling plan by an 
international sampling conmittee. Careful national and international 
validation of measuring instruments and data collection has been a 
feature of the study at every point, and there is good evidence to 
suggest that the instruments used reached an acceptable level of 
reliability. Centralised analysis of all data was carried out in 
Wellington, New Zealand for the cross-sectional study and Chaitpaign, 
Illinois for the associated longitudinal study. 

Intended Curriculum 

At the time of the first IEA mathematics study, the curriculum reform 
movement in mathematics was only in its infancy. Since then, vigorous 
curriculum development has taken place in many countries, and the 
second study hzs as its central concern a detailed analysis of the 
various mathematics curriculums offered, and the settings in which they 
operate. 

The curricular intentions of each ooivriry were obtained by examining 
syllabuses, curriculum guides and textbooks, and also through a series 
of Wbrking Papers involving questionnaires aonpleted by the IEA 
National Centers. From these sources, a conprehensive 'menu 1 of 
mathematics topics was drawn up, designed to include all those topics 
likely to be taught at the two levels in any IEA country. The 
Population A content outline originally contained 133 categories under 
five broad classifications: arithmetic, algebra, geometry, statistics 
and measurement. 

Following the approach outlined by Wilson in Bloom et al (1981), a 
'content by behaviors' grid was formed to determine the patterns of 
enphasis of subject natter appropriate for such a study. The vertical 
dimension of the grid consisted of the five topic areas listed above, 
whilst the horizontal dimension was divided into four levels of 
increasing cognitive conplexity: computation, conprehension, 
application and analysis. Conputation was defined to include the 
ability to recall specific facts, use mathematics terminology and carry 
out algorithms ; conprehension implied the ability to recognise 
concepts, principles and rules, follow a line of nathematical reasoning 



ERLC 



1. See Appendix Tables A2 to A5 for sanple numbers. 

6 



or read and interpret a problem. The application behavioral level 
required the solving of routine problems, making comparisons , 
recognising patterns and analysing data, while the highest level of 
all, analysis , was defined to include the solving of non-routine 
problems, discovering relationships and formulating generalizations. 

Following a lengthy process of international validation, described 
fully in the reports from the Study, weights were attached to the 
various cells in the grid, and an international pool of items selected 
to reflect the agreed-on enphasis. At a later stage in the study, 
prior to testing, IEA National Centers were asked to rate each item in 
the international pool on how acceptable or appropriate its subject 
natter would be in their, own country. 

They vere advised that the key element in judging the appropriateness 
of an item should be the mathematical skill or knowledge contained in 
the item rather than its particular form. 



The following rating scale was used: 

2 - the item is highly appropriate to the national curriculum 
1 - the item is acceptable 

0 - the item is inappropriate (because its mathematical content is 
not in the curriculum). 

After categories 1 and 2 had been aOTibined, these ratings formed the 
basis for the variable termed the index of intended content coverage , 
the percentage of items in the test regarded as acceptable or highly 
appropriate in each country. The index may be regarded sinply as 
providing an indication whether an item was seen to be in the official 
syllabus for a particular country, or not. It gives a general 
inpression of the 'fit 1 of the international item pool to the 
curriculum of each country, and a vantage point from which to consider 
other aspects of the teaching process. 

Implemented Curriculum 

The teacher has well been called the 'gatekeeper 1 of the curriculum. 
Within the constraints of the education system in each country, it is 
the classroom teacher who eventually decides what aspects of the 
curriculum shall be taught, how much time shall be allotted to each 
topic, and how it shall be taught. For the international study of the 
implemented curriculum, therefore „ a number of quest ionnaires were 
developed, to be oonpleted by teachers. From one of these it was 
possible to obtain a measure which previous IEA studies had described 
as 'cpportunity-to- learn 1 . In the present study this variable has been 
re-named as inplemented content coverage . If the mathematical content 
required to answer a particular item has not been taught, either in the 
year of testing or in some prior year, it would be unreasonable to 
regard low scores on that item as an indicator that something is amiss. 
The students have sinply not been given the 'opportunity -to-learn 1 it, 
in school, because it has not been covered. The curriculum has not 
been inplemented as it was intended. 
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In order to quantify this Treasure, three separate questions were asked 
of each teacher about each item in the test: 

During this school year, did you teach or review the mathematics 
needed to answer the item correctly? 

_A No 
B Yes 

If, in this school year, you did not teach or review the 
mathematics needed to am *er this item correctly, was it because: 

A It had been taught pr iot to this school year 

B It will be taught later (this year or later) 

C It is not in the school curriculum at all 

D For other reasons. 

From these questions, it was possible to determine whether the 
nathenatics content for an item had been: 

. taught or reviewed during the year 

. not taught or reviewed, because it was assumed that it had been 

covered in a previous year 
. not taught or reviewed. 

The sum of the first two categories provided a 'teacher cpportunity-to- 
learn 1 score, or teacher index of implemented content coverage, for 
each item, to be interpreted as the percentage of teachers judging that 
their class had had the opportunity to learn the necessary content and 
skills to tackle the item. Vben aggregated to the country level, after 
appropriate weighting, it provided a national indicator for each item, 
relating to the iitplemented curriculum, an index which oould 
conveniently be conpared with the appropriateness index, relating to 
the intended curriculum. 

A check on this measure was provided by the students themselves, who 
were asked to respond to each item by saying whether they had been 
taught the necessary mathematics 'this jear 1 , 'in previous years' or 
■never 1 . The sum of the first two categories for this variable gave a 
■student cpportunity-to-learn' score, or student index of inplernented 
content coverage, paralleling the teacher' index, for each item. When 
aggregated to the national level, this index oould be interpreted as 
the percentage of students in the country claiming that they had had a 
chance to learn the mathematics needed to do the item. 

Several countries did not request this information from their students. 
Some were concerned about the extra load it would place upon them in 
answering the tests, and the consequent increase in time needed. 
Others were unsure about the likely validity of any answers vhich might 
be given. Nevertheless for the subset of countries for which both 
teacher and student indices were available, a oonparison between them, 
and an examination of large discrepancies vhich occurred for particular 
items, provides some interesting insights into the teaching and 
learning process, and is a central concern of this report. 
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Attained Curriculum 

In order to assess pupil outcomes, that is, the attained curriculum, 
test items, questionnaires and attitude scales were developed. The 
validation process is fully described in the official volumes from the 
Study. The achievement items were designed to measure the pupils 1 
knowledge of areas of the mathematics curriculum which had been agreed 
as iitportant by the National Centers and their cotmdttees in 
participating countries. Some countries ran a longitudinal study 
utilizing a pre-test/post-test design on student achievement. Other 
countries confined themselves to a cross-sectional study, using the 
post-test only. For the purposes of this study, the outcome measures 
(which could be regarded as indices of attained content coverage ), are 
various sub-scores on the post-test measure, expressed as national 
percentages of students choosing the correct response on the 
constituent items. Only those 157 items conrnon to both the cross- 
sectional and the longitudinal studies are included in this analysis. 
All are multi-choice items, and no corrections for guessing have been 
applied, as the current state of research on this topic suggests that 
standard formulae are probably not applicable. 

A final index forms something of a bridge between the implemented and 
the attained curriculum. This has been termed the teacher estimate of 
student achievement , and was obtained by asking teachers what 
percentage of the students in the target class did they estimate would 
get each item correct, without guessing. By aggregating these item 
responses to a national level, after appropriate weighting, it is 
possible to see how accurate vrere teachers' perceptions both of what 
they had taught and how well they thought their classes would perform 
on each item. The index was also designed to detect whether teachers, 
in assessing the 'opportunity-to-learn ■ scores for their students, were 
able to distance themselves from the likely performance of the sane 
students on the post-test. If the relationship between this index and 
the 'opportunity-to- learn' index were too close, it would cast some 
doubt on their validity. Wfe would then be justified in calling into 
question the capacity of teachers to assess accurately whether or not 
their students had had the necessary exposure to particular topics to 
allow then to display mastery of these topics in tests and exam- 
inations. Analyses in selected countries have shown only moderate 
correlations between the two indices, and, with certain exceptions to 
be noted and discussed later, it would appear that teachers in most 
countries are able to assess rather accurately the probable test 
performance of their students. The validity of their 'cpportunity-to- 
learn 1 assessments is, of course , the major focus of the present 
paper. 

Relationships Between the Curriculums 

One might anticipate a close relationship between the intended 
curriculum, the inplemented curriculum, and the attained curriculum, in 
each CDuntry. The goals and aspirations of the mathematics educators 
who have the responsibility of shaping the curriculum are accurately 
perceived by teachers and translated into appropriate and effective 
instructional sequences in the classroom. Students in their turn, have 
an alert perception of the dimensions of the curriculum vhich they are 

ERIC 



- 7 - 



studying, and this is reflected in the measured outcomes of their 
learning, in brief, topics which are in the syllabus, are being taught 
by teachers and mastered by pupils. 

A lack of articulation between the intended and the inplenented 
curriculuns could then be interpreted as a lack of 'conformity 1 in the 
educational system, a signal that the intentions of the policy makers 
and curriculum developers are not being put into practice with a 
oonprehensiveness that they would consider desirable. Some teachers, 
especially in decentralised school systems not constrained by the 
dictates of national examinations, may. hold a contrary view. They 
vould argue that the individual needs of students with differing goals 
and abilities cannot be met by a 'lock-step 1 approach, and that such 
1 non-conformity 1 is a desirable feature of an educational system Good 
teachers should welcome the professional freedom to choose their own 
textbooks and plan their own curriculum enphases and flexible work 
sequences . 

A lack of articulation between the implemented and the attained 
curriculum could, on the other hand, be interpreted as a lack of 
■efficiency 1 in the system, if topics vhich students are given an 
I opportunity-to-learn 1 (because they are in the intended and 
inplemented curriculums and regarded as important) are not topics on 
which they can demonstrate high levels of achievement when tested. 
This aould be attributed to poor teaching, inadequate facilities, or 
skinpy treatment of topics because of overfull timetables and conpeting 
curriculum offerings. It is also likely to be influenced by the 
varying enphases and preferences expressed by teachers for particular 
topics, and corresponding enphases and preferences shown by students in 
studying than. It may also be the result of inaccurate or highly 
unrealistic perceptions on the part of teachers of the cumulative body 
of mathematics to which students have been exposed, inside and outside 
the classroom. 

The appendix to this report contains a number of detailed tables for 
those countries in the survey for which data were available for at 
least three of the five variables being considered. Tables Al to A5 
summarize scores for each variable in turn across subtests arri 
countries; Tables A6 to A22 give data for each country in turn across 
subtests and variables. In each case the items upon which tte tables 
are based are the pool of 157 ooimon to both cross-sectional and 
longitudinal studies (46 arithmetic, 30 algebra, 39 geonetry, 18 
statistics, and 24 measurement ). 

What follows is a very brief summary of the main outlines of the 
section on the intended and inplemented curriculums, to be fourri in 
Chapters 7 and 8 of the first volume of the TEA Second Study of 
Mathematics , provisionally entitled The International Mathematics 
Curriculum . This will set the scene for the more detailed analysis of 
discrepancies between student and teacher perceptions of rontent 
coverage given at the end of the report. 

Intended Content Coverage 



The item appropriateness ratings given in Table Al form a convenient 



way of describing the content of the intended curriculum in each 
country, and as they are tied to the actual items in the international 
pool, they allow comparisons with the other indices relating to the 
implemented curriculum. They also give a general inpression of how 
well the international item pool fitted the mathematics curriculum in 
each country. For exanple, the arithmetic items appeared to articulate 
well with the intended curriculum in every country, being a perfect fit 
in the U.S.A. and generally showing better than an 85 percent fit in 
the other countries. The measurement itenjs also appeared to be 
generally within the intended curriculum in all countries except 
Belgium and France. Coverage of statistics was very low in these 
countries , also in Israel and Luxembourg, where it barely figured in 
the intended curriculum at all. The algebra items were generally 
regarded as appropriate in all countries, except for Canada (Ontario) 
and the U.S.A. , where the Population A students were in primary rather 
than secondary school. Geometry showed a very diverse pattern, with 
enormous variation between countries. There is clearly no world 
consensus about what geometry should be taught at this level r and no 
country found more than about seven-eighths of the iters appropriate; 
many indeed found no more than half the items fitted their official 
curriculum. 

Inpleanented Content Coverage 

The scores given in Tables A2 and A3 give a suntnary of the perceptions 
of teachers and students in each country as to which of the items in 
the international pool they regarded as having been 'covered' in their 
mathenatics instruction. As far as the teachers were concerned, this 
required them to say whether they believed their students had had the 
1 opportunity-to-learn 1 the mathematics needed to do each item, either 
because they had taught or reviev^d it themselves during the year, or 
because they believed that it would have been taught in a previous 
year. The figures in Table A2 take on more meaning when they are 
oonpared with those in Table Al, to see where major discrepancies lie 
between what was intended to be aovered, and what teachers assumed or 
claimed had actually been covered. The differences between respective 
entries in these two tables are given in Table 1. 

A few exanples should make the method of interpretation clear. In 
Belgium (Fl.) the difference between the two indices for the Algebra 
subtest is given as 22 percent; reference to Tables Al and A2 shows 
that 93 percent of the items were judged by the Belgian (Fl. ) National 
Center as being appropriate for Population A, but teachers reported 
that, on average, only 71 percent of these items would have been 
covered prior to or during the Population A year in the country's 
classrooms, a difference of 22 percent. A difference in the reverse 
direction occurs in the Statistics subtest. The official view is that 
virtually none of the items would be appropriate (11 percent), but 
teachers assumed that their students would have had the 'opportunity- 
to-learn' as many as 38 percent of the items, a difference of -27 
percent. For the other three subtests, the discrepancies are less than 
20 percent; and the weighted total across all subtests is zero. 

It should of course, be recognized that the two indices (intention and 
implementation) are not strictly conparable, since the first is 
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obtained at the national level in each country, the second at the 
classroom (teacher) level and aggregated to the national level. But by 
focussing only on large discrepancies some cautious generalizations are 
in order. For some National Centers, notably Belgium (Fl. ) and France, 
it appears that the appropriateness ratings nay underestimate the index 
of intended coverage, since National Committees, in providing the 
ratings, judged some items inappropriate if the content had been 
prescribed to be taught earlier in the school system than the 
Population A level. This oould account for some of the negative 
differences in Table 1. Most countries classified such items as 
appropriate, since they fell within the cumulative mathematics syllabus 
up to the tine of testing. 

Teachers, on the other hand, in rating the items in some subtests, 
notably Statistics, oould be taking into account likely prior learning 
of mathematical concepts in other subjects of the curriculum (social 



Table 1 Differences* between indices of intended and irrplemented 
content coverage for Population A, by major subtest and 
country 



Measure- Weighted 

Country Arithmetic Algebra Geometry Statistics ment Total 

%%%%%% 



Belgium (Fl. ) 


9 


22 


-6 


-27 


-16 


0 


Canada (B.C. ) 


9 


2 


-7 


42 


18 


9 


Canada (Ont. ) 


-2 


-14 


27 


16 


-6 


4 


England & Wales 


19 


30 


33 


19 


18 


24 


Finland 


10 


8 


30 


33 


23 


19 


France 


-4 


11 


11 


-23 


-30 


-4 


Hungary 


2 


-1 


-1 


-2 


3 


0 


Israel 


25 


-3 


33 


-47 


41 


16 


Japan 


9 


10 


36 


25 


5 


17 


Luxembourg 


14 


21 


-12 


-10 


-3 


4 


Netherlands 


8 


7 


11 


29 


5 


11 


New Zealand 


26 


34 


28 


40 


30 


30 


Swaziland 


2 


-4 


-16 


6 


-5 


-4 


Sweden 


20 


26 


13 


53 


28 


24 


Thailand 


7 


-10 


14 


21 


14 


8 


U.S.A. 


16 


-6 


12 


28 


25 


14 



These differences have been calculated by subtracting each weighted 
national teacher 'qpportunity-to-learn 1 mean (TOTL) from the corres- 
ponding item appropriateness rating (SPPR), as given in Tables Al and 
A2. 

In this and the following three tables, differences exceeding 10 
percent might be regarded as interpretable. (See Statistical Note, 
p. 30) 
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studies , woodwork, technical drawing), and this oould also lead to 
negative differences. A number of graphical items in the tests, for 
exanple, could have been encountered by students at an earlier stage in 
other school settings outside the mathematics classroom. 

But itost of the differences in the table are positive, suggesting that, 
in general, intention runs ahead of implementation. In some countries , 
such as England and Vfeles, Finland, Israel, New Zealand, Sweden, and 
U.S.A., substantial differences run across all or almost all subtests; 
other entries such as Geometry for Ontario or Statistics for British 
Columbia show a substantial positive discrepancy in just one subtest. 

Large positive differences nay come about for several reasons. The 
first which comes to mind is sinply that there is more in the 
curriculum than is currently being taught in any given country; 
government officials responsible for the development of the mathematics 
curriculum are unduly optimistic about viiat teachers are reasonably 
able to cover during the regular course of a year's work (or should 
have covered in previous years). Under these circumstances, teachers 
may omit parts of the curriculum due to lack of time. 

A second explanation ray be that in countries vhere streaming or 
differentiated schooling is practised, classes of less able students 
may not cover as nuch mat hemat ics as classes of average or above 
average ability. Different content may be specified for the different 
streams or programs, and only the higher ability streams may be 
expected to cover the full content as intended in official 
prescriptions. 

Another situation likely to lead to large positive discrepancies can 
occur in aountries where Papulation A falls at the first year of post- 
primary school. This occurs in British Oolumbia, Finland, Japan, New 
Zealand and Sweden. It is probable that teachers at this level will 
not be entirely familiar with content taught in different types of 
school at the primary level, and so will be unable to rate accurately 
whether their present ratudents have covered it or not. This oould well 
account , in part at least , for t he number of large pos it ive 
discrepancies in these countries. 

The final observation above leads naturally on to a consideration of 
the second measure of the implemented curriculum, the student index of 
inplemented content coverage, or student 'opportninity- to- learn' score. 
This was designed as a check ^n the teacher index, to throw light on 
such eventualities as those just mentioned, and provide an independent 
student perception of vhat mathematics had actually been taught. A 
number of National Centres did not collect this information, and some 
of those that did collect it were doubtful about its validity. No 
discussion of this index therefore occurs in The International 
Mathematics Curriculum , but it may not be out of place to discuss it 
here, provided due caution is exercised in its interpretation. 

Table 2 presents a series of percentage differences between the student 
and teacher indices of inplemented coverage, constructed in a similar 
way to those in Table 1. Differences are not as large, suggesting a 
greater consonance between teachers and their students, than between 
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teachers and those who prescribe the curriculum. There appears to be 
good agreement in arithmetic and in measurement, except in Israel, and 
also in algehra. The presence of negative differences in this table 
suggests that there are some items in the tests which do not appear to 
be familiar to students but which are regarded by teachers as having 
been covered. This is especially so in Swaziland and may be either a 
reflection of over-cptimism on the part of the teachers or lack of 
appreciation o£ exactly what they had been taught on the part of the 
students. Generally the differences are positive, and it is 
interesting to conjecture why this should be so. 



Table 2 Differences* between student and teacher indices of 
inplemented content coverage for Population A, by 
major subtest and aountry 



Measure- Weighted 

Country Arithmetic Algehra Geometry Statistics merit Total 

%%%%%% 



Canada (B.C. ) 


-3 


-10 


12 


19 


3 


3 


France 


-8 


-7 


17 


11 


-11 


0 


Hungary 


1 


-2 


2 


-1 


-3 


0 


Israel 


20 


3 


31 


31 


24 


21 


Japan 


3 


7 


30 


15 


-1 


11 


Luxembourg 


-7 


0 


12 


13 


-4 


2 


New Zealand 


8 


4 


14 


12 


9 


9 


Nigeria 


3 


3 


4 


6 


5 


4 


Swaziland 


-7 


-14 


-5 


-12 


-11 


-9 


Thailand 


1 


0 


20 


18 


4 


8 



♦These differences have been calculated by subtracting each weighted 
national teacher 'opportunity-to- learn 1 mean (TOTL) from the corres- 
ponding national student 'opportunity-to- learn' mean (SOTL), as given 
in Tables A2 and A3. 



National Centers in some countries , such as Thailand, reported a 
general tendency on the part of students to over- rate all items. This 
tendency also showed ip in Israel (very strongly), Japan, New Zealand, 
and Nigeria, but need not necessarily be interpreted as undue optimism 
or lack of realism on the part of the students. There nay be an 
element of this, where students failed to detect hidden difficulties in 
an item because it had a superficially familiar appearance. Teachers 
may have been able to detect the hidden traps which, in their view, 
placed .the item outside the syllabus . 

But, perhaps a more likely reason why the student index of inplemented 
coverage should be larger that the teacher index is that students were 
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quite aorrectly identifying the item as belonging to a topic they had 
covered previously, but one about which their current classroom teacher 
nay have lacked information. More detailed analysis, at the item 
level, arid not presented here, shove that this is indeed the case. 
Almost invariably, the major contributing cause for large discrepancies 
was a high percentage of responses from students claiming they had been 
taught the mathematics necessary to do the item 'in previous j^ars 1 
(See p. 5). Sometimes this may have been in mathematics classes at an 
earlier stage , in primary rather than secondary school, sometimes 
incidentally in the course of instruction in other subjects , sometimes 
outside the school during special coaching lessons, and perhaps 
sometimes just in the process of informal learning away from school 
altogether. These differences are explored at the item level in 
subsequent analyses, illustrated by reference to comtents drawn from a 
number of countries. They clearly suggest that a treatment of content 
coverage, seen purely from a teacher perspective, may give only a 
partial picture of the cunulative body of mathematical knowledge to 
which students have been exposed. 



Table 3 Differences* between teacher indices of implemented content 
coverage and student post-test scores for Population A, by 
major subtest and country 



Measure- Weighted 

Country Arithmetic Algebra Geometry Statistics ment Total 





% 


% 


% 


% 


% 


% 


Belgium (PI.) 


18 


18 


-11 


-20 


25 


8 


Canada (B.C. ) 


29 


37 


8 


-9 


26 


20 


Canada (Ont.) 


33 


29 


7 


5 


35 


23 


England & Wales 


31 


23 


9 


4 


33 


21 


Finland 


30 


25 


-4 


-7 


17 


14 


France 


28 


31 


5 


-7 


33 


20 


Hungary 


34 


41 


33 


25 


35 


34 


Israel 


17 


36 


5 


-5 


13 


15 


Japan 


25 


23 


-6 


5 


26 


15 


Luxembourg 


34 


22 


10 


-5 


32 


21 


Netherlands 


22 


22 


14 


-34 


21 


13 


New Zealand 


22 


23 


15 


3 


25 


19 


Nigeria 


38 


40 


38 


27 


40 


37 


Swaziland 


53 


62 


49 


47 


57 


54 


Sweden 


27 


18 


-4 


-9 


19 


12 


Thailand 


43 


45 


19 


12 


38 


33 


U.S.A. 


33 


27 


6 


15 


34 


23 



*These differences have been calculated by subtracting each national 
mean post-test score (POST) from the corresponding lighted national 
teacher cpport on it y-to- learn mean (TOTL), as given in Tables A2 and A5 
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Attained Content Coverage 



Table 3 shows an iitportant set of oonparisons at the subtest level , 
that between the teacher index of inplemented content coverage and the 
index of attained content coverage (irean student scores on the post- 
test, expressed as percentages). The differences in the table migltt be 
regarded as a crude measure of the efficiency of the learning process 
in the classrooms of each country, and as such take on considerable 
significance. The raw data are contained in Appendix Tables A2 and A5. 
For the purposes of this table, it is assumed that the teacher index of 
the inplemented curriculum is a more valid indicator that the student 
index, although for certain topics in some countries there is evidence 
that the student index may be preferable. However, the teacher index 
was supplied by more countries, and was generally taken to be better 
one to use in the official reports of the study. 

The results in the table suggest that the countries fall into three 
reasonably well-separated groips. The first, containing Belgium (PI.) 
Israel, Japan, Netherlands, Sweden and Finland, shows small differences 
in the weighted total column, not more than 15 percent. The second, 
with weighted total differences clustering tightly around 20 percent, 
contains Canada (B.C.), Canada (Ont. ), England and Vfeles, France, 
Luxembourg, New Zealand and U.S.A. The third, with differences well in 
excess of 30 percent, contains Hungary, Nigeria, Swaziland and 
Thailand. An v ^jnination of the rank orders of entries in each subtest 
column shows air degree of consistency; Group 3 countries tend to 
show the largpsu discrepancies in each topic area, Group 1 countries 
the smallest. 

If we are to take the teacher's perception of what has been taught, or 
presumed taught, to be accurate, then this suggests that Group 1 
countries are the most 'efficient 1 in producing test results, and Group 
3 the least. This difference is an important statistic to consider 
alongside post-test scores in each oountry, for it would be unwarranted 
and unfair to pass judgement about student performance on the basis of 
post-test scores alone, without seme acooirpanying idea of how much of 
the mathematics in this test had been taught, or presumed taught, by 
teachers • 

The below-average post-test scores for Finland, England and Vbles, 
Luxembourg, New Zealand, Sweden and U.S.A. (Table A5) can be viewed in 
a new light when it is realised that their students have not had the 
■opportunity-to- learn 1 as much of the mathematics in the international 
item pool as those in other countries classified in Groups 1 and 2. 
When this is taken into account, their performances are rather more 
comparable. Or at least that is how it would appear if teacher 
perceptions of content coverage are to be given credence as possessing 
adequate validity. 



2. The cautions given in Table A2 with respect to Hungary, Israel and 
Swaziland results should be noted here, as they may affect these 
oonparisons . 

is 
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Statistics and geometry stow up as two subtests in vhich a considerable 
amount of incidental learning takes place, almost entirely in Group 1 
aountries, and so the differences are smaller, even negative in a few 
countries. What may not be taught in the classroom is picked ip in 
some other way. For the remaining three subtests it would seem as 
though much of the learning takes place in the classroom, and the 
measure of vhat mathematics is presumed taught and the measure of what 
is demonstrated as learned, differ more widely. 

Another relationship worthy of at least passing attention is that 
between the prior teachers ' estimate or assessment of what they 
believed their students would score on the post-test and the actual 
subsequent performance of the students. The definitions of these 
scores were given on pp. 5-6. The differences between these two sets 
of scores, aggregated with appropriate weighting to the national level, 
are given in Table 4. The raw data are contained in Appendix Tables A4 
and A5. To illustrate: the difference of 11 for Nigeria shows a con- 
sistent tendency on the part of Nigerian teachers at the Population A 
level to over-estimate the performance of their students in the post- 
test. This is particularly pronounced in the measurement subtest, 



Table 4 Differences* between teacher estimates of student achievement 
and student post-test scores for Population A, by major 
subtest and country 



Measure- Weighted 



Country 


Arithmetic Algebra Geometry Statistics 


ment 


Total 




% 


% 


% 


% 


% 


% 


Belgium (PI. ) 


-10 


-2 


8 


1 


0 


-1 


Canada (B.C. ) 


-4 


4 


13 


-7 


2 


2 


Canada (Ont.) 


2 


14 


14 


0 


3 


7 


England & Wales -2 


-3 


-10 


-16 


1 


-5 


Finland 


0 


0 


-15 


-14 


-2 


-6 


France 


-5 


1 


14 


2 


-1 


2 


Hungary 


3 


4 


1 


-3 


8 


3 


Israel 


3 


-2 


-16 


-25 


-3 


-7 


Japan 


-2 


-1 


-13 


-11 


4 


-5 


Luxembourg 


4 


2 


-5 


-6 


8 


1 


Netherlands 


-2 


1 


-3 


-18 


2 


-3 


New Zealand 


-6 


7 


-2 


-15 


1 


-2 


Nigeria 


9 


14 


13 


4 


15 


11 


Swaziland 


11 


14 


8 


6 


12 


10 


Sweden 


-6 


-3 


-9 


-15 


-11 


-8 


Thailand 


6 


10 


7 


2 


-2 


5 


U.S.A. 


-4 


5 


11 


-11 


6 


2 



*These differences have been calculated by subtracting each national 
mean post-test score (POST ) from l;he corresponding weighted national 
mean teacher estimates of student achievement (TESA), as given in 
Tables A4 and A5. 
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(with teachers estimating a national mean of 45.2 percent, and students 
actually obtaining a national mean of 30.7 percent, a difference of 
approximately 15); it is least noticeable in the statistics subtest 
(with corresponding figures of 40.6 and 37.0, difference approximately 
4). The presence of negative differences in many countries shows the 
opposite tendency, with teachers, nationally, under-estimating the 
likely performance of their students. A small negative difference 
would be expected, on average, because teachers were asked not to take 
guessing into account when making their estimates, and no allowance for 
guessing was built into the post-test scores. Teachers in Nigeria and 
Swaziland appeared to consistently over-estimate the performance of 
their students; to a lesser extent this is also true in Thailand and 
Ontario. The overall estimates in each of the other countries appear 
to be quite accurate, although there are major fluctuations in some of 
the subtests. Performance in geometry and statistics seems difficult 
to predict accurately, and it will be recalled that these two topic 
areas also seemed to generate the largest discrepancies between the two 
'opportunity-to-learn 1 indices, discussed in Table 2. However, a 
oonparison betveen teacher estimates of curricular coverage and teacher 
estimates of class achievement is rightly the topic of another study, 
and will not be elaborated on here. 

3 

Item Appraisal 

Table A23 in the appendix presents the results of a more fine-grained 
analysis at the item level, similar to that contained in Table 2 for 
the five main topic areas; arithmetic, algebra, geometry, statistics 
and measurement. There were 73 items out of 157 which net the 
(arbitrary but convenient) criterion of showing a discrepancy of ever 
30 percentage points in at least one country between the teacher and 
student indices of iitplemented content coverage (21 out of 46 items in 
arithmetic, 6 out of 30 items in algebra, 27 out of 39 in geometry, 14 
out of 18 in statistics, 5 out of 24 in ireasurement ) . In other words, 
there were 73 items where students differed quite widely from their 
teachers in their perceptions of whether they had had the opportunity- 
to- learn the mathematics necessary for success. 

An exanple should aid in interpreting the entries in the table. The 
first entry refers to Item 7 in the core form of the longitudinal post- 
test (coded X7), vrfiich was re-positioned as Item 13 in the core form of 
the test used in the cross-sectional study. For this geometry item, 
three countries shoved differences between student and teacher indices 
of iitplemented content coverage exceeding 30 percent, namely Canada 
(B.C.), New Zealand and Thailand. The differences of 45, 36 and 34 
percent, respectively, are all positive, showing that in each of these 
countries the students took the more 'optimistic 1 view about their 
' opportunity- to-learn 1 the mathematics needed to do this particular 
item. 



3. Thanks are due to the National Centers in Ccinada (B.C. ), Hungary, 
Japan, New Zealand and Thailand for their help in carrying out this 
item appraisal. 
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The following section discusses a representative selection of those 
items showing large discrepancies in several countries. Comments on 
these items are appended from officers in the respective National 
Centers , giving their explanations for the discrepancies observed. To 
obtain reactions from all countries on all items would have been too 
large a task, but full statistics are included in Table A23 for 
ootipleteness . 

Some general characteristics of the discrepancy table can be noted. 
Israel, New Zealand and Japan show the largest number of positive 
discrepancies, confirming results already noted at the subtest level 
that, in these countries, teachers of Population A students may be 
unaware of what mathematical knowledge had been acquired at earlier 
levels, in school or outside the school, and so under-rate the exposure 
of their students to the mathematics needed to answer items in the 
test. Very few negative differences occur, reinforcing the observ- 
ations already made at the subtest level that, in general, Population A 
students tend to err on the generous side in their perceptions of what 
they have been taught. This is least true in France, but even there, 
positive entries in Table A23 outveigh negative ones. 

Arithmetic Items 

Arithmetic and geometry are the subtests giving rise to the largest 
proportions of discrepant answers, across all countries in the survey. 
In arithmetic, however, the picture tends to be idiosyncratic. 
Different countries show discrepancies in different items; there are 
very few such items aointDn to nore than three countries , and most occur 
in just a single country. 

4 

Items A17 and D12, involving the understanding of a sequence 
expressed in diagrammatic form, could be done by sixtple deduction, or 
drawing and counting rows, and d? not necessarily involve mathematics 
which would have been specifically taught. This was the observation of 
the British Columbia National Center with regard to Item D12, and 
almost certainly it would apply to Item A17 as vrell. Students would 
have been familiar with diagrams of this type, but teachers may not 
have deliberately taught the actual mathematical skills needed to solve 
the problem. The fact that students said that they had had the 
■opportunity-to-learn 1 the item does not necessarily mean they got it 
correct, of course, but sinply that it looked familiar to them. 

Items A30 and C33 deal with square roots, a topic not found in a number 
of official syllabuses at this level. Finland, Japan, New Zealand, 
Swaziland and Sweden reported these items as inappropr iate for 
Population A students, and low intended coverage was indicated in 
Belgium (French and Flemish), France, Hungary and Ireland. 



4« In the following discussion, all items will be referred to by their 
longitudinal numbers. They are illustrated in the form in which 
they appeared in the New Zealand version of the post- test, hut 
somewhat coup acted and photo- reduced to save space. 

O to 

ERLC Iy 



- 17 - 



A17 lit row 
2nd row 
3rd row 
4th row 
5th row 



1 A 0 

1-1 B 1 

1-1*1 C 2 

1-1*1-1 B 25 

1-1*1-1*). E 30 



Vtist is the sua of the 50th row? 
D12 Matchsticks are arranged as follows: 

n> co> cco> 



If the pattern is continued, how many matchsticks are 
used in asking the 10th figure? 



A 

B 
C 
D 
E 



A24 



A33 



30 
33 
36 
39 



C33 Since 4 x 9 - 36, /36 is equal to 
A 4x9 
B 4x3 
C 2x9 

D 2x3 

E /2 x /3 

A30 What is the square root of 12 x 75? 



A 6.25 
B 30 
C 67 

D 625 

E 900 



If 10 2 x 10 3 r 10 n then n is equal to 



0.00046 is equal to 



A 

B 
C 
D 
E 



46 x 16 J 
4.6 x 10~ 
0.46 x 10 3 
4.6 x 10* 
46 x 10 5 



The New Zealand situation is particularly interesting here, since 
exanples of square roots are given in the two officially prescribed 
textbooks for the two years immediately prior to the Population A year, 
but they do not appear in the official, national syllabus until the 
year following. It appears that many primary and intermediate school 
teachers in New Zealand have followed the textbook and not the syllabus 
in teaching the topic. The teachers at Population A level, the first 
year of secondary schooling, do not appear to be aware of this prior 
learning, because they use a variety of different textbooks of their 
own choosing. 

The presence of a square root button on cheap electronic calculators is 
another factor which should not be overlooked. These are coirmonly 
owned by students in New Zealand, and irrespective of whether the topic 
was in the syllabus or not, the way to get square roots f ran a 
calculator was likely to be well known by many Population A students. 
The concept itself may not have been grasped, of course, and so Item 
A30 nay have looked nore familiar to the students than Item C33. 
Results from Table A23 suggest that this was so, as the discrepancy 
between teacher and student, est urates for Item A30 is 46 percent, for 
Item C33 only 32 percent. 

In Hungary, at the time of the Second IEA Mathematics Study, three 
mathematics curriculums were in use at the Population A level: the 
traditional curriculum, a 'transitory curriculum 1 and an experimental 
version of the 'new 1 cnarriculum. A little less than half the students 
would have been on the traditional 'classical' curriculum at the time 
of the survey. Square roots were included in the transitory and new 
experimental curriculums, but not in the traditional one. It is 
likely, then, that teachers accustomed to the traditional curriculum 
may not have had a clear idea of the extent of prior exposure of their 
students to the new material. 

The Thai National Center noted that square roots were right at the end 
of the textbook in the Populat ion A year , and the topic may not 
therefore have been covered by the time of the survey. The students 
may have misunderstood the problem as sinply requiring them to find the 
product of the two numbers given, and there is evidence to suggest from 
an examination of their responses that this is just what they did. 

Another topic which appeared to generate differing perceptions was that 
of indices. Items A24 and A33 (the latter classified as Algebra, but 
treated here for convenience) were again part of tile transitory and 
experimental curriculums in Hungary, and ware not generally taught in 
New Zealand. For these items, students nay have had the opportunity to 
learn the elementary notions of 'standard form' in science classes, 
rather than in mathematics. 

The Hungarian National Center noted that all of the topics generating 
differences (and there were only five for Hungary) were covered in the 
special mathematical clubs of the Bolyai Janos Mathematical Society. 
Since a large number of more able students participate in these 
activities, they nay have answered 'yes 1 to the question on 
'opportunity- to- learn 1 , in spite of the fact that the topics ware not 
mentioned in school. Hungary also made the suggestion that students 
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scoring poorly on these items, ana generally showing low performance in 
mathematics as a subject, may believe that they probably had been 
taught the mathematics necessary to cb the items, and that failure was 
their own fault. 



A35 



-10 



ao 



Which of the following sequences of numbers is in 
the order in which they occur from left .to right 
on the number line? 



0, -1 



c 

D 



0, -1, j 



-1. - j. o 



-1. 0, - f 



- -i, o 



B5 



For the table shown, a formula that relates m and a is 
A 



n = m 
n = 3rn 
n « m' * I 
n **m* * 1 
n * 2m * 1 





-1 


1 


2 


4 


n 


-1 


3 


5 


9 



C16 If x « y s 2 & 1, then * ; " is equal tc 



A -2 

B -1 

C 0 

• I 

E 1 



Algebra Items 

There are relatively few algebra items showing major country 
differences between student and teacher perceptions of ' opportunity- to- 
learn' , and they fall into no simple groupings. Only three items (A3 5, 
B5 and C16) show differences exceeding 30 percent in more than one 
country. What is significant however, is that the differences are 
virtually all negative . Notably, A35 and C16 are items where the 
students are consistently under-rating their exposure to the topic, in 
comparison with their teachers. The items may be unusual in the way in 
which the information is presented, just a little 'off the beaten 
track 1 , and therefore regarded as unfamiliar. The teachers on the 
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other hand, nay quite correctly regard the underlying principles as 
being within the syllabus r aid consider that the mathematics necessary 
to do the items has been taught. More than that it is difficult to 
say. In general, student and teacher perceptions in algebra appear to 
correspond quite closely, worldwide. 



A6 The triangles shown below are congruent* What is x? 
A 52 
B 
C 
D 



E 

Bl*| A ABC andAA'B'C* are congruent and their corresponding sides 
are parallel. A ABC maps onto A A'B*C* by c 

reflect ion 
glide reflection 
rotation 
enlargement 
translation 



C32 Triangle PQT can be rotated onto triangle SQR. The centre of rotation is 
A Point P 

p 

B Point Q 
C Point R 

Q 

D Point S 
E Point T 



R 



Geometry Items 

A large number of geometry items show substantial discrepancies across 
many countries , and only a representative sanple of them will be 
analysed here. . Three topics figure largely among these discrepant 
items: oongruency, similarity and Pythagoras' theorem. Items A6, B14 
and C32 deal with congruence (B14 and C32 in a transformation geometry 
context), and there were four other congruence items not illustrated 
here (Core21, C29, D16 and D22), showing large differences in several 
countries. Items Core40 (coded X40) and C9 deal with similar 
triangles. 

a 23 
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The question to be raised here is how much do correct ansvaers in 
geometry depend on intuition, 'conmon sense 1 or general knowledge , and 
how much do they depend upon instruction in mathematics . In New 
Zealand, intuitive ideas of congruence and similarity were included in 
the syllabus and in the official textbooks for the two years prior to 
the Population A year. But there is evidence to show that, at the time 
of the survey, secondary school teachers were not fully aware of this, 
and under-estimated the exposure of their pipils to geometrical 
concepts. They comnonly begin to teach these topics anew within a 
transformational geometry framework in the Population A year, on the 
assuitption that their students know little or nothing about them. A 
parallel situation prevails in British Columbia, where elementary 
school students are also presented with intuitive ideas of congruence 
ana similarity, before the Population A year. 

The Thai National Center observed for Item C32 that 'rotation 1 is a 
common everyday term, and remarked that students could probably solve 
the problem without understanding 'rotation 1 in the technical , 
transformational geometry sense. The teachers 1 responses, however, 
would largely be swayed by the fact that 'rotation 1 is not aovered in 
the normal curriculum. 

Results for Items B6 and D16 (not illustrated) further enphasise this 
tendency. It is reported that Thai teachers would regard 'line of 
symmetry 1 in Item B6 as not in the curriculum for Population A, but 
students, unfazed by the unfamiliar technical vocabulary, would attenpt 
to solve the problem using intuitive ideas of congruence. Item D16 
extends the concept of congruence to four-sided plane figures, and once 
again, students nay have recognised the word 'congruence', and used 
their initiative in extending the 'same size and shape 1 schema into an 
unfamiliar situation. New Zealand teachers may have noted the term 
■glide reflection' in one of the distr actors for Item B14 and ruled the 
item as a whole out of the curriculum, whereas many students, seeing 
the general appearance of the item was familiar, and untroubled by such 
cues, would rate it as acceptable. 

Similar triangles are covered right at the end of the official Grade 8 
mathematics textbook in Thailand, and may not have been covered in all 
schools at the time of the IEA survey. Teachers would rate the items 
accordingly, but the students might not regard 'similar' in Items 
Core 40 and C9 as a key word, and imagine that they were familiar with 
facts about triangles (Item C9) or perhaps thought they could solve 
I ton Core 40 by estimation or measurement. 

Items B25 and CI deal with Pythagorean triangles, a topic not in the 
intended curriculum in a number of countries at this level. The 
Hungarian National Center reported it as in the transitory and new 
experimental curriculums only, not in the traditional, and this could 
account for the discrepancy in their country, as it did for the 
arithmetic items previously mentioned. Pythagorean triangles of the 
(3,4,5) variety were given a very cursory treatment in the official 
syllabuses and textbooks for the last two years of prinary school in 
New Zealand, but did not figure in the Population A year syllabus at 
all, at the time of the IEA survey. Teachers at this level were 
apparently unaware of the possible prior exposure of pupils to 
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Triangles PQR and STU are liailar. Hov long is SU? 



C9 If two triangles are SIMILAR, vhich of the following statements is TRUE? 
A Their corresponding angles MUST be equal. 
B Their corresponding aides MUST be equal. 
C Their corresponding sides MUST be parallel. 
D They MUST have the same area. 
£ They MUST have the same shape and size. 



B25 Which of these is a correct statement for this triangle? 




A. x> - 3> ♦ 4* 

B x> ♦ 3» - 4* 

C x - 4* - 3* 

D x 1 = 4 J - 3 J 



k 

E x - U ♦ 3 
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elementary applications of Pythagoras 1 theorem, and under-rated their 
familiarity with it. There is, too, at least the possibility that 
students nay have come across the concept as the basis for generating 
right angles in woodwork or netalwork classes. On the other hand, in 
Item Cl (a 5,12,13 triangle and not a 3,4,5 one) they nay sinply have 
made a careful estimate, or used a little inspired guesswork. This 
last was the suggestion from the Thai National Center, which noted once 
again that the topic came near the end of the textbook used for 
Population A students, and may not have been covered, by be ache ^ in 
tine for the IEA survey. 



X7 

The diagram ahowa a cardboard cube which haa been cut along aooe edgea 
and folded out flat. If ic ia folded Co again make the cube, which 
two cornera will touch P? 



A cornera Q and S 

B cornera T and Y 

C cornera W and Y 

D cornera T and V 

E cornera U and Y 



P Q R 




i 

U V 










MHO 
Z 




X V 

1 



X19 




The length of the circumference of the circle with centre at 0 is 
26 and the length of arc RS ia 4. What ia the aize in degreea of 
the central angle ROS? 



A 24 

B 30 

C 45 

D 60 

E 90 




The figure above ahowa a wooden cube with one 
corner cut off and ahaded. Which of the following 
drawings ahowa how thia cube would look when viewed 
from directly above it. 
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Three other geometry items deserve some nention here, 0ore7, 0orel9 and 
A15, as at least three countries showed discrepancies exceeding 30 
percent between student and teacher perceptions of aontent coverage for 
these items. In Item Core7, students were being tested on their 
understanding of basic concepts of spatial relations , and ifational 
Centers in at least three countries observed that, although such an 
item wuld perhaps not be specifically caught by teachers in the 
classroom, nevertheless intuitive ideas of nets of 3-dimensional 
figures should have been introduced to students in elementary school. 
Item Corel9 is another which teachers in many countries regarded as 
lying outside their syllabus , because 'length of arc of a circle 1 was 
not specifically included. But the intuitive mathematical under- 
pinnings nay well have been present with their students, in work with 
fractions, or pie charts or siirply logical reasoning. item A15 is 
another which tests basic spatial perceptions, and would be unlikely to 
find a place in the normal textbooks used by students at this level. 
The British Columbia National Center observed that basically no 
mathematics was needed, and the low rating on the part of teachers 
probably sinply reflects this fact. The students said they knew enough 
to tackle the item, but the teachers did not regard it as mathematics 
in the formal sense. 



C6 There are five black buttons and one red button in a jar. If you pull 
out one button at random* what is the probability that you will get 



the red button. 



Statistics items 

Although 14 out of 18 statistics items showed discrepancies of over 30 
percent between teacher and student perceptions of inplemented coverage 
in at least one country, these tended to be idiosyncratic. Very few 
items shoved consistent discrepancies across a number of countries, and 
there v:^re no topics within the subtest which stood out as providing 
more than their share. Only one is illustrated here, Item C6. This 
shoved T cge positi/e differences across virtually every country listed 
in Tab^ A23, and it is not difficult to see why. Elements of 
probability theory jre not normally introduced into school syllabuses 
at this level, and this was the only item in the test on probability. 
But concepts of choice and chance are becoming increasingly common in 
the everyday life of students, in the games they play and the concepts 
they form, and they nay well have felt that the material in the item 
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was familiar, whether or not they were able to get it right. The item 
could almost be regarded as tapping general knowledge, and not formal 
mathematical skills. 



X10 


A solid plasti 


c cube with edges 


1 centimetre long 


A 


8 


grams 




weighs 1 gram. 


How much will a 


solid cube of the same 










plastic weigh 


if each edge is 2 


centimetres long? 


B 


A 


grsms 










C 


3 


grams 










D 


2 


grsms 










E 


1 


gram 



Measurement Items 

Only one item in the measurement subtest (Item Core 10 ) , showed 
differences exceeding 30 percent in more than ore country. This would 
seem to be a topic Wiere teacher and student perceptions of aontent 
coverage are very much in agreement, and such differences as do occur 
are idiosyncratic. The response from the British Columbia National 
Center suggests that in this item the students did not really perceive 
the difficulty of the problem, and notes that their response was rather 
too facile. This was confirmed by observations from the New Zealand 
National Center, with the romment that a large percentage of students 
made a serious conceptual error in choosing option D (2 grams) as the 
answer. The cuastion clearly contains hidden traps, and the teachers' 
perceptions o£ whether or not items like this had been covered are 
likely to be the more accurate. 

Coaching 

Another element in explaining differences not encountered in the 
responses from other countries was mentioned by the Japanese National 
Center. Table A23 shows a consistent tendency for very large positive 
differences to occur between Japanese students and teachers in their 
perceptions of the inplesnented curriculum. These differences are by 
far the largest in the table, and occur in all subtests, but 
particularly in geometry. The cause appears to be the practice of 
large-scale tuition in mathematics outside the school in coaching 
classes of one form or another, a reflection of the intense pressure to 
achieve which is characteristic of the Japanese school system. 
Students attending such classes aoirmonly cover more than the officially 
prescribed school curriculum. This phenomenon has already been noted 
in Hungary, with more able students attending the special mathematical 
clubs of the Bolyai Janos Mathenatical Society. Infonral mathematics 
clubs for students exist in other countries beside Japan and Hungary, 
but are generally seen as having a recreational and enthusiasm- 
generating role, and not a strict teaching one. The Japanese 
experience nay be unique, and almost certainly accounts for the large 
discrepancies noted in many entries in Table A23. 



28 



- 26 - 



Sunroary 

1. The nodel of the three curriculums is central to this report. At 
the level of the education system there is the intended curriculum, 
containing the, 'official 1 view of what is prescribed to be taught in 
mathematics in #&ch country. At the second level, the level of the 
classroom, there in the implemented curriculum, the body of math- 
enatical krowle&je which is actually taught, or presumed taught, to 
students by teachers. Finally, the information and skills mastered by 
the students, as demonstrated in tests and questionnaires , makes up the 
attained or achieved mathematics curriculum. 

2. It is obvious that the implemented curriculum need not bear a 
strong resemblance to the intended curriculum, and it is the 
inplemented curriculum, not the intended one, v*iich finally determines 
the students ' opportunity to learn mathematics. The level of 
correspondence between the two cur r iculums might be termed the 
conformity of the educational system. The sinple index of conformity 
used in this report demonstrates that in most countries, and for most 
mathematics topics, intention runs ahead of iitplementation. Large 
positive differences in all or almost all subtests showed up in England 
and Wales, Finland, Israel, New Zealand, Sweden and U.S.A. Such a lack 
of 1 conformity 1 nay occur for several reasons. The official curriculum 
developers may be over-opt imis t ic about what teachers are reasonably 
able to aover in their courses. Or the presence of differentiated 
instruction, either in separate schools or in streamed classes, may 
mean that low ability students are not expected to cover as nuch 
mathematics as the official prescription suggests* Finally, teachers' 
perceptions of exactly what mathematics has already been taught to 
their students may be inaccurate. This phenomenon is particularly 
likely in countries where the tested population falls at the first year 
of post-primary school. This occurs in British Columbia, Finland, 
Japan, New Zealand and Sweden. Under these circumstances, teachers may 
not be entirely familiar with the mathematics taught at the primary 
stage, and so under-estimate both the exposure of students to 
particular topics and their likely performance on test items related to 
them. 



Some teachers would argue that 'non-conformity' of this type in an 
educational system may not necessarily be a bad thing. This argument 
is likely to be net more often in decentralised school systems 
unconstrained by national, external examinations. Such teachers are 
likely to value the professional freedom to choose their own textbooks, 
and to plan flexible work prograns to suit the individual needs of 
students of differing mathematical abilities. 
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3. An independent check on the 'conformity' of educational systems 
was provided , in a limited number of countries, by the students 
themselves , vho rated their familiarity with the mathematics needed to 
do each item in a similar (but not identical) way to that of their 
teachers. By and large, the students agreed with their mathematics 
teachers on the extent of syllabus coverage. The correspondence was 
close in arithmetic, algebra and measurement, in rrost countries, but 
rather less so in geometry and statistics. In general, the student 
index of inplemented content coverage was greater than the teacher 
index, and the reason for large positive discrepancies was almost 
invariably the large proportion of students claiming that they had had 
the opportunity to learn the necessary mathematics 'in previous years'. 
Sometimes this may have been in mathematics classes at an earlier 
stage, in primary rather than secondary school, sometimes in the course 
of other school subjects, special coaching lessons or mathematics 
competitions, and sometimes just in the process of informal learning 
outside the classroom environment altogether. 

4. It is patently clear that there can also be a lack of corres- 
pondence between what teachers believe they have taught and what their 
students can demonstrate they have learnt. The degree of articulation 
between the inplemented curriculum and the attained curriculum could 
be seen as a measure of the efficiency of an educational system. Such 
a system could not be described as 'efficient' if mathematical topics 
which students are given an 'opportunity- to- learn 1 (because they are in 
the intended and the implemented curriculums and regarded as important) 
are not topics on which they can show high levels of achievement when 
tested. Conversely, one ought not to criticise the performance of a 
system in t which students are unable to perform vrall on topics which 
they have not been taught. The index of 'efficiency' used in this 
report is thus an inportant indicator to consider along with achieve- 
ment scores, if unfair oonparisons are not to be made between countries 
with different curricular enphases in mathematics. 

5. Results from a detailed appraisal of particular items showed that 
the perceptions by teachers and students of the extent of the 
inplemented curriculum were reasonably consonant in most topics in the 
algebra and measurement subtests, in every country. In other words, 
teachers agreed with students over what mathematics had been taught. 
In the other three subtests, there were a large number of items showing 
discrepant results. Arithmetic showed an idiosyncratic picture, with 
different countries showing discrepancies in different topics. These 
included square roots, indices and sequences, with teachers generally 
being more conservative in their perceptions of what material they 
believed their students would be familiar with. Geometry provided a 
large number of discrepant items , part icularly in the topics of 
congruence, similarity and Pythagoras' Theorem. This almost certainly 
reflects a lack of knowledge on the part of teachers of work which had 
been covered previously in other schools, at the primary level, or of 
material picked up informally in other contexts outside the mathematics 
classroom. 
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APPENDIX TABLES 



The tables upon which this report is based are drawn from the 
datasets of the IEA r Second International Mathematics Study. The 
data in this report were processed at the International Data 
Processing Center, Wellington, New Zealand. Copies of the data 
tapes may be obtained from them or from the U.S. Department of 
Education, Center for Statistics. The survey procedures and 
sampling methods for this study will be reported in three 
official volumes of the Second IEA International Study of Mathe- 
matics. Their titles are: Volume I. Curriculum Analysis ? Volume 
II. Data Collection M Analysis q£ £h£ Cross-sectional StMfly; 
and Volume III. A nalysis of the Longitudinal Study and 
Classroom Processes , These volumes will be published as they are 
completed by the IEA committees. 
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Statistical Note 

Tables Al to A5 which follow, plus Table A23, form the main source 
of data for this investigation. Tables A6 to A22 were derived 
from Tables Al to A5 by rearranging the data by country, and 
rounding all percentages. The standard errors in Tables A2 to A5, 
along with the sanple sizes listed, will give some idea of the 
precision with which the various percentage means can be 
estimated. Table Al, which was the fruit of the aombined 
judgement of members of the IEA National Conmittee in each 
participating country* does not present statistics based on random 
sanples, and so includes no standard error columns (S.E. ) or 
sanple N's. 

As the four textual tables upon vhich the discussion largely 
focusses consist of columns of differences between percentage 
means, aggregated with appropriate weightings to the national 
level, some estimate of the size of difference which might be 
interpretable is perhaps desirable. This is not a straightforward 
matter. Some of the differences (those between means relating to 
subtests within a country) are derived from correlated variables, 
and the usual calculation for the significance of a difference 
between un-aorrelated means will over-estimate the percentage 
difference necessary for a statistically significant result. On 
the other hand, the sanples in the survey were not sinple random 
ones, but conplex, multi-stage sanples, subject to various stratum 
weightings to ensure the f inal st at ist ics were nat ionally 
representative. This introduces the possibility of large 'design 
effects 1 , specifically when the statistics relate to students vho 
have been selected by intact class groups in differentiated 
systems where streaming, either overt or aovert, is in operation. 
This factor will act in the opposite direction, and increase the 
size of difference necessary before statistical significance can 
be claimed. Finally, it is necessary to distinguish between 
statistical significance and educational significance. With large 
random sanples, very small differences may become statistically 
significant, but for all practical purposes these differences may 
be negligible as far as educational importance is concerned. 

A sinple, and relatively conservative approach is suggested in 
interpreting the statistics shown in these tables. It is based on 
the observation that if two un-oor related means have standard 
errors of 1.8, the usual 't-test' suggests that a difference of 
about 5 points may be considered statistically significant at the 
0.05 level (t>1.96). In fact, of all the standard errors in 
Tables A2 to A5, 262 out of 305 (86%) do not exceed 1.8 percent; 
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40 out of the 43 larger differences are in Tables A2 and A4, with 
their smaller samples, comprising teachers rather than students, 
and not subject to inflating design effects. If the figure of 5 
percentage points is multiplied by a factor of 2, to make a very 
rough allowance for design effects resulting from the sampling 
strategies applied in the various countries, we arrive at a 
convenient (and slightly arbitrary) figure of 10 percentage 
points as a minimum which might be regarded as significant and 
worthy of interpretation. The present study will only concern 
itself, with large differences, substantially greater than 10 
percent. 



Accuracy of the data 

The statistics reported for the countries participating in the 
Second International Mathematics Study are based on sample sur- 
veys conducted within each participating country. A sufficient 
number of schools was chosen in each country to provide a nation- 
al estimate of cognitive student achievement and other character- 
istics which might be compared with those of other countries. 
The statistics reported in this report contain national summaries 
of several topics (such as achievement levels on many mathematics 
items as completed by students or coverage levels as completed by 
teachers) . Comparisons between items within a country are made 
with the same sample and are, therefore, more likely to be 
reliable than comparisons between countries. 

Errors of sampling, data processing, loss of items in transmis- 
sion of data from 6ne country to the international processing 
center, and reporting errors may have occurred. Also, cultural 
biases may affect the meaning of items. The research centers 
participating in the study carefully evaluated each test item 
during meetings of representatives from each country reduce the 
possibility of bias through misinterpretation of its intent. 

Each national center was provided with a sampling manual of 
detailed procedures. The manual suggested stratification by geog- 
raphic region, systematic ordering of schools within strata, 
random selection of schools and of one or two intact classes 
within selected schools. It also recommended replacement of non 
responding schools from a parallel sample. These systematic 
procedures were followed in every country. However, some varia- 
tions in their actual implementation occurred. A detailed report 
of the sampling procedures for each population in each country is 
available upon request from the Center for Statistics. This 
report shows that most countries followed strict rules for scien- 
tific sampling of classrooms for the study. 

For the United States response rates at two stages of sampling 
were below 70 percent resulting in a total response rate of about 
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40 percent of the intended sample. All other countries, with the 
exception of England, were able to achieve a response rate of 
greater than 90 percent. In England, the response rate was about 
71 percent. The reliability of national estimates for the United 
States when compared with other countries should be treated with 
caution. 

A comparison of the characteristics of students in the achieved 
sample for the United States with those of the total student 
population suggests that the achieved sample may have included 
students with higher social and economic backgrounds than the 
national distributions would warrant. Thus, cognitive achieve- 
ment scores for the United States are more likely to be biased 
upward than downward in this study. 
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Table Al Population A item appropriateness ratings, by major subtest and country 



Country Arithmetic Algebra Geometry Statistics feasurement 

* I I t % 



Belgium (Fl. ) 84.8 93.3 

Belgium (Fr.) 84.8 93.3 

Canada (B.C.) 95.7 86.7 

Canada (Ont.) 84.8 56.7 

England & Wales 97.8 93.3 

Finland 84.8 76.7 

France 82.6 96.7 

Hong Kong 91,3 80.0 

Hungary 93.5 90.0 

Israel 91.3 76.7 

Japan 93.5 93.3 

Luxembourg 93.5 73.3 

Netherlands 89.1 80.0 

New Zealand 93.5 96.7 

Scotland 100.0 90.0 

Swaziland 87.0 83.3 

Sweden 87.0 75.9 

Thailand 93.5 73.3 

U.S.A. 100.0 63.3 
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66.7 
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11.1 
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79.2 
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100,0 


69.2 


83.3 


91.3 


53.8 


27.8 


62.5 


69.2 


83.3 


91.7 


84.6 


83.3 


100.0 


74.4 


0.0 


100.0 


87.2 


100.0 


100.0 


23.1 


22.2 


79.2 


76.9 


61.1 


87.5 


87.2 


100.0 


100.0 


89.7 


100.0 


100.0 


64.1 


88.9 


87.5 


48.7 


100.0 


95.8 


71.8 


77.8 


100.0 


56.4 


100.0 


100.0 
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Table A2 Population A teacher 'opportunity-to- learn 1 scores, by major subteBt and country 



Arithmetic Algebra Geometry Statistics Measurement Median 
Country Mean* S.E. Mean* S.E. Mean % s.E. Mean % S.E, Mean % S.E, N 



Belgium (Pi. ) 


75.6 


1.4 


70.9 


2.6 


31.3 


1.5 


38.4 


2.3 


83.1 


1.4 


138 


Canada (B.C. ) 


86.9 


1.2 


84.6 


1.6 


50.6 


2.6 


52.0 


3.4 


77.6 


2.7 


78 


Canada (Ont. ) 


87.0 


1.0 


71.0 


2.0 


50.3 


2.3 


61.5 


2.5 


85.4 


1,6 


159 


England & Kales 


79.1 


0.9 


63.1 


1.6 


53.8 


1.4. 


64.0 


1.8 


81.9 


1.1 


379 


Finland 


75.1 


0.7 


68.5 


1.2 


38.8 


1.5 


50.5 


1.6 


68.7 


1.3 


199 


France 


86.1 


0.5 


86.1 


0.9 


43.3 


1.1 


50.7 


1.8 


92.0 


0.5 


333 


Hungary 


91.1 


1.2 


90.9 


0.9 


85.9 


0.8 


85.5 


1.6 


97.3 


1.1 


63 


Israel 


66.6 




79.6 


■a 


41.0 




47.2 




59.2 




136 


Japan 


84.9 


0.3 


83.4 


0.5 


51.3 


1.1 


75.4 


1.0 


94.7 


0.5 


209 


Luxentourg 


79.4 


0.9 


52.8 


2.1 


35.0 


1.2 


32.3 


1.2 


81.7 


1.0 


84 


Netherlands 


81.3 


0.9 


73.1 


1.5 


66.3 


1.3 


31.7 


2.1 


82.5 


1.2 


224 


New Zealand 


67.4 


1.4 


62.7 


1.7 


59.3 


1.4 


59.9 


2.6 


70.4 


2.1 


169 


Nigeria 


78.7 




72.5 




64.5 


mt 


63.7 




71.0 


H 


30 


Swaziland 


84.9 




87.3 


a. 


79.7 


m* 


82.8 


** 


92.3 




24 


Sweden 


67.5 


1.3 


49.8 


1.9 


35.3 


1.4 


47.4 


2.2 


67.4 


1.6 


177 


Thailand 


86,1 


1.0 


83.0 


1.1 


57.9 


2.5 


57.1 


3.4 


86.3 


1.4 


90 


U.S.A. 


84.3 


1.0 


68.9 


2.0 


44.2 


2.1 


72.2 


1.9 


75.2 


1.9 


269 



The final column contains the median number of teachers responding to the 'opportunity-to-learn' question 
on one or more post-test items, taken over the five test forms. This number is ' ubsiantially the same 
as the number of teacher responses upon which the subtest scores in this tabk ;v based, with three 
exceptions? Hungary, Israel and Swaziland. In these three countries, and more t K cularly in Swaziland, 
response rates varied widely from item to item, and due caution should be effitcr d in interpreting 
results based upon these figures. In each case, the assumption has been made that the replies from 
non-responding teachers would have been distributed across categories in the sane way as those of 
respondents. Because of this possible lack of validity, or small sample size, no standard errors have 
been given for Israel, Nigeria or Swaziland. 
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ible A3 Population A student 1 opportunity-to- learn 1 scores, by major subtest and country 



Arithmetic Algebra Geometry Statistics Measurement Median 

;ry Mean % S.E. Mean % S.E. Mean % S.E. Mean % S.E. Mean % S.E. N 



la (B.C.) 


83.7 


0.7 


74.6 


1.1 


62.8 


1.3 


71.1 


1.1 


80.8 


1.0 


91 




78.3 


0.4 


79.0 


0.6 


59.8 


0.6 


61.5 


0.6 


81.5 


0.5 


193 


iry 


92.0 


0.6 


89.3 


0.7 


87.4 


0.6 


84.3 


1.0 


94.0 


0.5 


70 


!l 


86.1 


1.0 


82.8 


1.4 


72.3 


1.5 


78.5 


1.5 


83.4 


1.2 


99 


1 


88.0 


0.2 


90.2 


0.3 


81.1 


0.3 


90.1 


0.3 


93.3 


0.2 


210 


itourg 


72.3 


1.0 


52.9 


2.1 


47.3 


1.2 


44.8 


1.9 


77.7 


0.9 


113 


tea lard 


75.8 


0.7 


66.8 


1.0 


73.7 


0.7 


72.1 


0.8 


79.4 


0.7 


104 


:ia 


81.2 


1.0 


75.8 


1.3 


68.8 


1.4 


70.1 


1.5 


75.5 


1.3 


48 


Land 


82.6 




78.3 




77.7 




80.8 




83.5 






Liana 


77.9 


1.5 


73.7 


1.5 


75.0 


1.4 


71.2 


2.0 


81.4 


1.4 


25 


Lard 


86.8 


0.4 


83.4 


0.5 


77.8 


0.6 


75.5 


0.8 


89.8 


0.4 


100 



Jtudent •opportunity-to-learn 1 scores were aggregated to school/class level r in order to calculate 
weighted national estimates given in this table. The final column contains the nedian number of 
)ls/classes from which data were available in each country, taken over the five test forms. No entry 
Lven for Scotland, since intact classes were rot sanpled in that country. 
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s A4 Population A teacher estimates of student achievement f by major subtest and country 



Arithmetic Algebra Geometry Statistics Measurement 

ry Mean % S.E. Mean % S.E. Mean % S.E. Mean % S.E. Ifean % S.E. N 



um (Fl.) 


47.6 


1.1 


50.6 


1.3 


50.3 


1.3 


58.9 


1.2 


58.0 


1.1 


264 


a (B.C.) 


53.7 


1.9 


52.3 


2.3 


55.0 


2.2 


54.2 


1.8 


53.8 


2.2 


87 


a (Ont.) 


56.0 


1.8 


55.9 


1.7 


57.2 


2.1 


56.7 


1.4 


53.7 


1.8 


107 


rri & Wales 


46.1 


0.6 


37.2 


0.5 


34.9 


0.6 


44.6 


0.5 


49.7 


0.5 


416 


™a 


45.4 


1.3 


43.9 


1.1 


28.6 


1.0 


44.1 


1.1 


49.4 


1.3 


204 




52.8 


1.5 


55.7 


1.9 


52.2 


1.9 


59.6 


1.5 


58.2 


1.3 


185 




59.6 


2.0 


54.4 


2.0 


53.9 


2.4 


57.2 


2.0 


70.5 


1.5 


70 


1 


53.3 


1.4 


41.8 


0 9 


19.8 


1.0 


27.4 


1.1 


43.1 


1.2 


153 


bourg 


58.2 


1.5 


59.0 


I A 


44.5 


1.6 


59.5 


1.1 


72.2 


1.0 


212 


49.4 


1.6 


33.3 


1.1 


20.6 


1.5 


30.9 


1.4 


58.2 


1.4 


107 


r lands 


56.9 


0.8 


52.3 


1.1 


48.6 


1.2 


47.6 


0.9 


63.8 


o.y 


235 


Balarri 


39.5 


1.7 


46.1 


1.8 


42.4 


1.8 


42.0 


1.3 


46.3 


1.6 


97 


ia 


50.2 


1.6 


46.1 


2.5 


39.1 


1.8 


40.6 


1.4 


. 45.2 


1.6 


45 


land 


43.5 


3.2 


39.4 


2.4 


39.0 


3.8 


42.2 


3.0 


46.9 


2.4 


25 


i 


34.3 


1.6 


29.3 


1.4 


30.0 


1.4 


41.8 


1.1 


37.4 


1.6 


186 




48.6 


i.6 


48.1 


1.4 


46.0 


1.9 


47.1 


1.6 


46.0 


1.9 


99 


• 


47.0 


1.5 


46.8 


1.4 


48.8 


1.6 


46.8 


1.0 


46.3 


1.3 


151 



42 

41 
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Die A5 Population A post-test scores, by major subtest and country 



Arithmetic Algebra Geometry Statistics Measurement Total 



intry 


Mean % 


S.E. 


Mean % 


S.E. 


Mean % 


S.E. 


Mean % 


S.E. 


Mean % 


S.E. 


N 


.gium (Fl.) 
gium (Fr.) 


58.0 


1.4 


52.9 


1.7 


42.5 


1.1 


58.2 


1.5 


58.2 


1.3 


3073 


57.0 


1.8 


49.1 


2.0 


42.8 


1.5 


52.0 


1.7 


56.8 


1.5 


2025 


ada (B.C.) 


58.0 


1.3 


47.9 


1.4 


42.3 


1.2 


61.3 


1.3 


51.9 


1.3 


2168 


ada (Ont.) 


54.5 


0.9 


42.0 


0.8 


43.2 


0.8 


57.0 


0.9 


50.8 


0.9 


4666 


land & Wales 


48.2 


1.3 


40.1 


1.3 


44.8 


1.2 


60.2 


1.1 


48.6 


1.2 


2612 


iland 


45.5 


1.0 


43.6 


0.9 


43.2 


0.8 


57.6 


1.0 


51.3 


0.9 


4382 


inoe 


57.7 


0.5 


55.0 


0.8 


38.0 


0.5 


57.4 


0.6 


59.5 


0.4 


8317 


g Kong 


55.1 


1.5 


43.2 


1.2 


42.5 


1.0 


55.9 


1.4 


52.6 


1.4 


5495 


gary 


56.8 


1.5 


50.4 


1.6 


53.4 


1.4 


60.4 


1.3 


62.1 


1.2 


1754 


ael 


49.9 


1.5 


44.0 


1.6 


35.9 


1.3 


51.9 


1.5 


46.4 


1.3 


3524 


an 


60.3 


0.4 


60.3 


0.5 


57.6 


0.4 


70.9 


0.4 


68.6 


0.4 


8091 


embourg 


45.4 


1.3 


31.2 


1.7 


25.3 


0.8 


37.3 


1.3 


50.1 


1.1 


2038 


her lands 


59.3 


1.1 


51.3 


1.2 


52.0 


1.0 


65.9 


0.9 


61.9 


1.0 


5418 


' Zealand 


45.6 


1.2 


39.4 


1.1 


44.8 


1.0 


57.3 


1.1 


45.1 


1.1 


5176 


eria 


40.8 


1.1 


32.4 


0.7 


26.2 


0.7 


37.0 


1.0 


30.7 


0.9 


1414 


tland 


50.2 


0.5 


42.9 


0.7 


45.5 


0.6 


59.3 


0.5 


48.4 


0.7 


1320 


iziland 


32.3 


1.4 


25.1 


1.5 


31.1 


1.3 


36.0 


1.7 


35.2 


1.3 


817 


den 


40.6 


0.9 


32.3 


0.8 


39.4 


0.8 


56.3 


1.1 


48.7 


1.0 


3451 


iland 


43.1 


1.3 


37.7 


1.0 


39.3 


0.9 


45.3 


1.0 


48.3 


1.1 


3824 


.A. 


51.4 


1.2 


42.1 


1.2 


37.8 


0.9 


57.7 


1.1 


40.8 


0.9 


6648 



final column contains the total numbers of students in each country attenpting the core form of 
i test. In Swaziland and Sweden each student took, in addition, two of the four rotated forms 
B, C or D; scores on the items contained in these forms are thus available from approximately 
r-half this number of students. In all the other countries listed, each student attenpted only one 
ated form, and item scores are thus available from approximately one-quarter of the Total N given. 

items in each subtest were distributed across the five forms of the test. 

44 



ERIC 



- 37 - 



Table A6 Rational mean scores on selected variables related to the 
intended, implemented and attained curriculims, by topic 
subtest : Belgium (Fl.) 



INTENDED IMPLEMENTED ATTAINED 

Number CURRICULUM CURRICULUM CURRICULUM 

Subtest of items 

APPR TOTL SOTL TESA POST 

% % % % % 



Arithmetic 


46 


85 


76 




48 


58 


Algebra 


30 


93 


71 




51 


53 


Geometry 


39 


26 


31 




50 


43 


Statistics 


18 


11 


38 




59 


58 


Measurement 


24 


67 


83 




58 


58 


Total 


157 


61 


61 




52 


53 



NDTE : The following key applies to tables A6 to A22 

APPR Item appropriateness index 

TOTL Teacher 'opportunity^ to- learn ' index 

SOTL Student 'qpportunity-to-learn' index 

TESA Teacher estimate of student achievement 

POST Post-test score 

See pp. 2-6 for definitions 
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Table A7 National mean scores on selected variables related to the 
intended, inplesented and attained curr jjculums , by topic 
subtest : Canada (B.C.) 



INTENDED IMPLEMENTED ATTAINED 

Number CURRICULUM CURRICULUM CURRICULUM 

Subtest of items 

APPR TOTL SOTL TESA POST 

% % % % % 



Arithmetic 


46 


96 


87 


84 


54 


58 


Algebra 


30 


87 


85 


75 


52 


48 


Geometry 


39 


44 


51 


63 


55 


42 


Statistics 


18 


94 


52 


71 


54 


61 


Measurement 


24 


96 


78 


81 


54 


52 


Total 


157 


81 


72 


75 


54 


52 



Table A8 National mean scores on selected variables related to the 
intended, implemented and attained curricolums, by topic 
subtest : Canada (Ont. ) 



INTENDED IMPLEMENTED ATTAINED 

Number CURRICULUM CURRICULUM CURRICULUM 

Subtest of items 

APPR TOTL SOTL TESA POST 

% % % % % 



Arithmetic 


46 


85 


87 




56 


55 


Algebra 


30 


57 


71 




56 


42 


Geometry 


39 


77 


50 




57 


43 


Statistics 


18 


78 


62 




57 


57 


Measurement 


24 


79 


85 




54 


51 


Total 


157 


76 


72 




56 


49 



ERIC 
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Table A9 National mean scores on selected variables related to the 
intended, implemented and attained curriculum, by topic 
subtest : England and Wales 



Subtest 


Number 
of items 


INTENDED 
CURRICULUM 




IMPLEMENTED 
CURRICULUM 




ATTAINED 
CURRICULUM 






APPR 
% 


TOTL 
% 


SOTL 
% 


TESA 
% 


POST 
% 


Arithmetic 


46 


98 


79 




46 


48 


Algebra 


30 


93 


63 




37 


40 


Geometry 


39 


87 


54 




35 


45 


Statistics 


18 


83 


64 




45 


60 


Measurement 


24 


100 


82 




50 


49 


Total 


157 


93 


68 




42 


47 


Table A10 


National 
intended j 
subtest 


mean scores 
, implemented 
: Finland 


oh selected variables related to the 
and attained curriculuns, by topic 


Subtest 


Number 
of items 


INTENDED 
CURRICULUM 




IMPLEMENTED 
CURRICULUM 




ATTAINED 
CURRICULUM 






APPR 
% 


TOTL 
% 


SOTL 
% 


TESA 
% 


POST 
% 


Arithmetic 


46 


85 


75 




45 


46 


Algebra 


30 


77 


69 




44 


44 


Geometry 


39 


69 


39 




29 


43 


Statistics 


18 


83 


51 




44 


58 


Measurement 


24 


91 


69 




49 


51 


Total 


157 


80 


61 




41 


47 
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Table All National mean scores on selected variables related to the 
intended, i gple —e r ted and attained curriculuaB, by topic 
subtest : France 



Subtest 


Number 
of items 


INTENDED 
CURRICULUM 




IMPLEMENTED 
CURRICULUM 




/ii -LMJ t\ir.| ) 

CURRICULUM 






APPR 
% 


TOTL 
% 


SOTL 
% 


TESA 
a 


POST 


Arithmetic 


46 


83 


Rfi 

Og 


7ft 
/ o 


JJ 


CO 

bo 


Algebra 


30 


97 


86 


79 


56 


55 


Geometry 


39 


54 


43 


60 


52 


38 


Statistics 


18 


28 


51 


62 


60 


57 


Measurement 


24 


63 


92 


81 


58 


60 


Total 


157 


69 


72 


72 


55 


53 



Table A12 National mean scores on selected variables related to the 
intended, inpleaented and attained curr iculums , by topic 
subtest : Hungary 



INTENDED IMPLEMENTED ATTAINED 

Number CIRRICUUM CURRICULUM OKRICUUM 

Subtest of items 







APPR 
% 


TOTL 
% 


SOTL 
% 


TESA 
% 


POST 
% 


Arithmetic 


46 


94 


91 


92 


60 


57 


Algebra 


30 


90 


91 


89 


54 


50 


Geometry 


39 


85 


86 


87 


54 


53 


Statistics 


18 


83 


85 


84 


57 


60 


Measurement 


24 


100 


97 


94 


71 


62 


Total 


157 


91 


90 


90 


59 


56 



Table A13 National mean scores on selected variables related to the 
intended, implemented and attained curriculxxns, by topic 
subtest : Israel 





Number 
of items 


INTENDED 
CURRICULUM 

APPR 
% 


TOTL 
% 


IMPLEMENTED 
CURRICULUM 

SOTL 
% 


TESA 
% 


ATTAINED 
CURRICULUM 

POST 
% 


Arithmetic 


46 


91 


66 


86 


53 


50 


Algebra 


30 


77 


80 


83 


42 


44 


Geometry 


39 


74 


41 


72 


20 


36 


Statistics 


18 


0 


47 


79 


27 


52 


Measurement 


24 


100 


59 


83 


43 


46 


Total 


157 


75 


59 


81 


38 


45 



Table A14 National mean scores on selected variables relatrf to the 
intended, implemented and attained curriculunB, by topic 
s ubtes t : Jap an 



Subtest 


Number 
of items 


INTENDED 
CURRICULUM 




IMPLEMENTED 
CURRICULUM 




ATTAINED 
CURRICULUM 






APPR 
% 


TOTL 
% 


SOTL 
% 


TESA 
% 


POST 
% 


Arithmetic 


46 


94 


85 


88 


58 


60 


Algebra 


30 


93 


83 


90 


59 


60 


Geometry 


39 


87 


51 


81 


45 


58 


Statistics 


18 


100 


75 


90 


60 


71 


Measurement 


24 


100 


95 


93 


72 


69 


Total 


157 


94 


77 


88 


57 


62 



49 
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Table A15 National mean soores on selected variables related to the 
intended, inplenented and attained curriculuiB, by topic 
subtest : Luxembourg 



Subtest 


Number 
of items 


INTENDED 
CURRICULUM 




IMPLEMENTED 
CURRICULUM 




ATTAINED 
CURRICULUM 






APPR 
% 


TOTL 


SOTL 
% 


TESA 
% 


POST 
% 


Arithmetic 


46 


94 


79 


72 


49 


45 


Algebra 


30 


73 


53 


53 


33 


31 


Geometry 


39 


23 


35 


47 


21 


25 


Statistics 


18 


22 


32 


45 


31 


37 


Measurement 


24 


79 


82 


78 


58 


50 


Total 


157 


62 


58 


60 


38 


37 



Table A16 National mean scores on selected variables related to the 
intended, inplenented and attained curriculums, by topic 
subtest : Netherlands 



Subtest 


Number 
of items 


INTENDED 
CURRICULUM 




IMPLEMENTED 
CURRICULUM 




ATTAINED 
CURRICULUM 






APPR 
% 


TOTL 
% 


SOTL 
% 


TESA 
% 


POST 
% 


Arithmetic 


46 


89 


81 




57 


59 


Algebra 


30 


80 


73 




52 


51 


Geometry 


39 


77 


66 




49 


52 


Statistics 


18 


61 


32 




48 


66 


Measurement 


24 


88 


83 




64 


62 


Total 


157 


81 


70 




54 


57 



50 
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ta ble A17 



^iSSS Q)ea n scores on selected variables relate to the 
^^™» iaple«ated airi attained cuxricolumSr by topi c 



iapleaented 
New Zealand 



Subtest 



«,_^ INTENDED 



IMPLEMENTED 
CURRICULUM 



ATTAINED 
CIFRICULUM 







APPR 
% 


TOTL 
% 


SOTL 
% 


TESA 
% 


POST 
% 


arithmetic 


46 


94 


67 


76 


40 


46 


Algebr a 


30 


97 


63 


67 


46 


39 


geometry 


39 


87 


59 


74 


42 


45 


Statistics 


18 


100 


60 


72 


42 


57 


^gasuremertt 


24 


100 


70 


79 


46 


45 


Total 


157 


94 


64 


74 




46 



Table A18 National on selected variables related to tba 

■ U1 ~ ,ded » inplenented and attained curriculuns, by t<^>i 0 
subtest :l«igeria 



Subtest 


Number 
of items 


Intended 
curriculum 

APPR 

% 


TOTL 
% 


IMPLEMENTED 
CURRICULUM 

SOTL 
% 


TESA 
% 


ATTAINED 
OBRICULUM 

POST 
% 


arithmetic 


46 




79 


81 


50 


41 


Algebra 


30 




73 


76 


46 


32 


Geometry 


39 




64 


69 


39 


26 


Statistics 


18 




64 


70 


41 


37 


Measurement 


24 




71 


76 


45 


31 


Total 


157 




71 


75 


45 


34 



51 



Table Al9 National nean scores on selected variables related to the 
intended, inplemenbed and attained curriculum, by topic 
subtest : Scotland 



Subtest 


Number 
of items 


INTENDED 
CURRICULUM 

APPR 
% 


TOTL 
% 


IMPLEMENTED 
CURRICULUM 

SOIL 
% 


TESA 
% 


ATTAINED 
CURRICULUM s 

POST 
% 


J\ r <i +. hm^t ic 


46 


100 




83 




50 


Algebra 


30 


90 




78 




43 


Geometry 


39 


90 




78 




46 


Statistics 


18 


100 




81 




59 


Measurement 


24 


100 




83 




48 


Total 


157 


96 




81 




48 



Table A20 National mean scores on selected variables related to the 
intented, inplenented and attained curriculuns, by topic 
subtest : Swaziland 



Subtest 


Number 
of items 


INTENDED 
CURRICULUM 




IMPLEMENTED 
CURRICULUM 




ATTAINED 
CURRICULUM 




APPR 
% 


TOTL 
% 


SOTL 
% 


TESA 
% 


POST 
% 


Arithmetic 


46 


87 


85 


78 


44 


32 


Algebra 


30 


83 


87 


74 


39 


25 


Geometry 


39 


64 


80 


75 


39 


31 


Statistics 


18 


89 


83 


71 


42 


36 


Measurement 


24 


88 


92 


81 


47 


35 


Total 


157 


81 


85 


76 


42 


31 



52 



Table A21 National moan scores on selected variables related to the 
intended, implemented and attained curriculuras, by topic 
subtest : Thailand 



OUULcbL 


Number 


CURRICULUM 




TMP T .FMFWTPT. 

CURRICULUM 




CURRICULUM 






M>PR 
a 


T0TL 


SOTL 


TESA 


POST 
ft 


Arithmetic 


46 


94 


86 


87 


49 


43 


Algebra 


30 


73 


83 


83 


48 


38 


Geometry 


39 


72 


50 


78 


46 


39 


Statistics 


18 


78 


57 


76 


47 


45 


Measurement 


24 


100 


86 


90 


46 


48 


Total 


157 


84 


75 


83 


47 


42 


Table A22 


National 
intended! 

o U Jk/ 1»W0 w 


mean scores 

r implemented 
• n c i 


on selected variables related to the 
and attained curriculums, by topic 


SrVi T 


Number 


INTENDED 
CURRICULUM 




IMPLEMENTED 
CURRICULUM 




ATTAINED 
CURRICULUM 






flPPR 


T0TL 
% 


SOTL 
% 


TESA 
% 


POST 
% 


Arithmetic 


46 


100 


84 




47 


51 


Algebra 


30 


63 


69 




47 


42 


Geometry 


39 


56 


44 




49 


38 


Statistics 


18 


100 


72 




47 


58 


Measurement 


24 


100 


75 




46 


41 


Total 


157 


82 


68 




47 


45 



53 
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Table A23 Differences* between student and teacher indices of implemented 
content coverage for Population A, by item and country 



ITEM COUNTRY (DDE 



IONG 


XSBC 


SUBT 


CBC 


FRA 


HUN 


ISR 


JAP 


LUX NZE 


NIG 


SWA 


THA 


X7 


xl3 


GE 


45 










36 




34 




X10 


dl7 


MB 


30 






32 




33 








X19 


x32 


GE 


33 






34 




43 






66 


X21 


c25 


GE 




32 




42 


63 










X33 


x26 


AR 












37 








X36 


x33 


pr 




-31 
















X37 


all 


PR 




-31 












-32 




X38 


al6 


PR 




-32 
















X39 


x38 


GE 


















37 


X40 


d29 


GE 


42 


75 




58 


80 


42 54 






40 


A2 


x5 


GE 


32 






36 


32 










A6 


x6 


GE 




30 




37 


68 


36 








A8 


b20 


GE 
















38 




A10 


al3 


GE 










46 






-31 




A12 


bl8 


ST 










35 










A15 


dl 


GE 


48 






57 




37 35 


32 






A16 


d26 


PR 


-34 


















A17 


b8 


PR 








45 


48 


30 








A19 


a24 


ST 












36 








A22 


x21 


ST 








35 












A24 


al7 


AR 






35 




30 


33 








A27 


x9 


GE 










37 










A30 


x34 


PR 












46 






39 


A32 


c31 


PR 












24 








A33 


b29 


AL 






46 






:o 




35 




A35 


xl 


AL 


-34 


-39 
















B3 


cl4 


ST 








30 












B4 


clO 


ST 








36 












B5 


a2 


AL 










35 






-30 


36 


B6 


bl5 


GE 








37 










32 


B8 


a34 


GE 








33 


38 










BIO 


dl5 


PR 
















-32 




Bll 


a6 


GE 
















35 




B13 


a4 


GE 








31 


34 










B14 


bl4 


GE 








37 


45 


38 








B15 


d22 


PR 










30 










B17 


b30 


ME 














33 






B19 


d34 


ST 


30 


















B25 


b3 


GE 






42 




46 










B28 


x24 


ME 




-41 
















CI 


x2 


GE 




68 


50 




58 


60 


30 


62 


47 


C2 


x30 


ME 












-30 








C6 


dll 


ST 


56 


42 




49 


86 


39 41 




33 


48 


C7 


al9 


ST 


40 






48 












C9 


c7 


GE 


31 


69 




64 


70 


43 45 






30 


CIO 


d33 


ST 












35 








C16 


cl5 


AL 


-34 












-31 


-34 





54 
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IDHj 


11 rW 


cnnr 
□UdI 


ply 


C*L) A 


HTTM 


TQp 


COUNTRY OOEE 
JM> LUX 




UT^ QUA THA 




azu 
















J 1 * 




r«i q 


0x0 


AO 








77 










UZU 


/RIP 










70 












CZZ 


AD 


















v_zz 


r?7 


AO 




ji 














P97 


xzo 


UIJ 










77 








UZ / 


HI Q 


OTP 

OA 


71 
















POP 


HQ 


AP 








72 










UZ7 




oCj 




77 




71 


57 


37 






LjU 


XZ / 


















47 






vie 




^7 






43 


34 




38 


P*3*3 


DZZ 


AT? 














79 
oz 




n7 


JJXZ 


AP 














77 




UD 




AT 
















— 56 


nR 


KIT 


cm 
Ol 










34 








m i 
u±± 


H97 














31 






D12 


x31 


fiR 


36 








47 


34 






Dl 7 


Qfc / 


AP 








34 










D15 


xl9 


GE 










44 






32 


D16 


b25 


GE 










51 


36 






D18 


d27 


GE 








34 










D21 


xl5 


ST 




30 








31 






D22 


d24 


GE 








53 


42 








D26 


c34 


AL 










59 








D29 


al8 


GE 










45 








D33 


x35 


AR 












-37 







*These differences have been calculated by subtracting the (unweighted) 
national teacher 'qpportimity-to-learn ' mean (TOTL) from the rorreapcrriing 
national student ' opportunity^to- learn ' mean (SOTL) f for each item; only 
items vhere the absolute value of this difference reached 30 percentage 
points in at least one country have been included,. 



KEY: IDN3 longitudinal test item number (X signifies Core Test) 

XSEC Cross-sectional test item number (x signifies Core Test) 

SUET Subtest: J« (Arithmetic), AL (Algebra), GE (Geometry), 
ST (Statistics ) , ME (Measurement ) 

CBC British Columbia 

ERA France 

HUN Hungary 

ISR Israel 

JAP Japan 

LUX Da^&TfJbourg 

NZE New Zealand 

NIG Nigeria 

SWA Swaziland 

THA Thailand 



ERLC 



